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(g) An image searching method and apparatus. 

(57) Image searching method and apparatus cap- 
able of perfomning high quality search out of 
image database by using color infomnation. A 
sample image which is used as a key to search, 
and which is made by the operator, is inputted 
by the sample image input unit 30, and the 
sample color infomnation extraction unit 50 ext- 
racts the HSV cx)lor space data out of the 
sample image, and the image color Infomiation 
extraction unit 40 extracts the HSV color image 
data from the Image database 20. Contribution 
factors deciding unit 60 decides a contribution 
factor of each component in the HSV color 
space, then the candidate image deciding unit 
70 calculates similarity, and decides the image 
candidates, then those images are displayed on 
the display unit 90. the control unit 80 controls 
entire image searching apparatus. 
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The present Invention relates to an image processing method and apparatus and, more particularly, to a 
method to search for an image out of an image database, and the apparatus capable of employing the method. 

As one of conventional methods to search for a necessary image out of an image database, there is a 
method that an operator makes an example of the desired image, and that the search is performed with ref- 
erence to color information of the image. The color infonmation is extracted from the desired image by using 
a color perception space which is composed of three elements, namely, hue, chromatlcity, and luminance (al- 
together, called 'the three attributes of colors', hereinafter). Then, similarity between the extracted color in- 
formation of the desired image and color information extracted from an image stored in the image database 
by employing the same color perception space, is examined. Thereby, the order of image candidates, which 
can be the same as or which can be similar to the desired image made by the operator, is decided based on 
similarity. The image candidate which has a higher similarity is more likely similar to the desired image. Then 
the images are displayed in order of similarity. 

Regarding color data, each contribution factor of the three attributes of color differs in accordance with 
values of the three attributes of the color. For instance, in a color which has low chromatlcity that is close to 
black or white, and low luminance, a contribution factor of hue which is an attribute to distinguish the difference 
of color, such as red, blue, and yellow, is also low. If the degree of the similarity is calculated on the assumption 
that the contribution factors of the attributes are the same for all the colors in spite of the aforementioned fact 
that the contribution factors actually differ, the searching quality becomes lower since low contribution values 
are included in the calculation of similarity. 

The present invention has been made in consideration of the above situation, and has as its object to pro- 
vide an image processing method and apparatus which make the quality of search by referring to color Infor- 
mation higher when an image is searched out of the image database, and which make It easier for an operator 
to search for the desired image. 

According to the present invention there is provided an image searching method for searching an Image 
database by using color information containing a plurality of color components, comprising a contribution factor 
calculation step of calculating a contribution factor of each color component of color information on the basis 
of the color information, a similarity calculation step of calculating similarity between the color Information and 
a plurality of predetermined color information based on the contribution factor of each color component of color 
information, and a sorting step of sorting color information corresponding to similarity in order of similarity, 
and of displaying images. 

According to a second aspect of the present Invention there is provided an image database searching meth- 
od which searches for an image from the image database by using color information, comprising a generating 
step of generating a sample image including color information, a contribution factor calculation step of calcu- 
lating a contribution factor of color information based on the color information of the sample image, a similarity 
calculation step of calculating similarity between the sample image containing the color Information and re- 
spective images from an Image database, according to the contribution factor, and a displaying step of dis- 
playing images from the image database on a display means In order of similarity. 

According to a third aspect of the present invention there is provided an image database searching appa- 
ratus comprising contribution factor calculation means for calculating a contribution factor of each color com- 
ponent of color information on the basis of the color information, degree of similarity calculation means for cal- 
culating similarity between the color information and a plurality of predetermined color information based on 
the contribution factor of each color component of color information, and display means for sorting color infor- 
mation corresponding to similarity in the order of similarity, and displaying images, wherein the apparatus 
searches for images by using color information containing a plurality of color components. 

According to a further aspect of the present invention there is provided an image searching apparatus com- 
prising generating means for generating a sample image including color information, contribution factor cal- 
culation means for calculating a contribution factor of color information based on the color information of the 
sample image, degree of similarity calculation means for calculating similarity between the sample Image con- 
taining the color information and respective images from an image database, according to the contribution fac- 
tor, and displaying means for displaying images from the image database in order of similarity, wherein the 
apparatus searches for the image from the image database by using color information. 

Other features and advantages of the present invention will be apparentfrom the following description tak- 
en in conjunction with the accompanying drawings, in which like reference characters designate the same or 
similar parts throughout the figures thereof. 

The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate 
embodiments of the invention and, together with the description, serve to explain the principles of the invention 
by way of example only. 

Fig. 1 is a block diagram showing a block diagram of an image searching apparatus in a first and second 
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embodiments; 

Fig. 2 is a flowchart of a searching processing sequence; 

Fig. 3 is a flowchart showing a procedure of making a sample image; 

Fig. 4 illustrates a structure of a display for designating colors when making of the sample image; 
Fig. 5 is a flowchart showing a process to determine similarity; 

Fig. 6 is a flowchart showing a process for calculating each contribution factor of the three attributes of 
color data; 

Fig. 7 illustrates a shape of a membership function of luminance; 
Fig. 8 illustrates a shape of a membership function of chromaticity; 

Fig. 9 is a flowchart showing a process for calculating the contribution factor using the membership func- 
tions; and 

Fig. 10 is a flowchart showing another process of calculating the contribution factor using the membership 
functions. 

Embodiments of the present Invention will be described in detail in accordance with the accompanying 
drawings. 

(First Embodiment) 

In the first embodiment, a HSV (H stands for hue, S is for chromaticity, and V is for luminance) color space, 
for instance, is employed as a color perception space for indicating color data by hue, chromaticity, and lumi- 
nance. In Fig. 1, reference numeral 10 denotes a stored image data input unit for inputting Image data to be 
stored in database, 20 denotes an image storage unit for storing the image data inputted at the stored image 
data input unit 10, and 30 denotes a sample image input unit for Inputting a sample image made by an operator 
to obtain the desired image, where the sample image input unit 30 has a pointing Input device 31 . Further, an 
image color information extraction unit 40 extracts color information out of the image data stored in the image 
storage unit 20 by using the HSV color space, a sample color information extraction unit 50 extracts color in- 
formation out of the sample image inputted at the sample image Input unit 30 by using the HSV color space, 
and a contribution factors deciding unit 60 decides contribution factors of hue H, chromaticity S, and luminance 
V of color data in the HSV color space. 70 is a candidate image deciding unit to decide the searched candidate 
images by calculating the similarity, 80 is a control unit to control the entire apparatus In this embodiment, 
and 90 is a display unit to display the searched candidate images. 

Fig. 2 is a flowchart showing an image searching process performed by the apparatus in Fig. 1. An Image 
searching process is explained below with reference to Fig. 2. 

At step S1, a sample image of a desired image is made and inputted by the operator at the sample image 
input unit 30, and the sample image is transmitted to the control unit 80. The process of making the sample 
image Is explained later In detail with reference to the flowchart in Fig. 3 and the illustration of the display in 
Fig. 4. 

At step S2, the sample color information extraction unit 50 extracts the color information, namely, the val- 
ues of the three attributes in the HSV color space. HI, SI, and V1, out of the inputted sample image. 

At step S3, the image color infomnation extraction unit 40 find a mode color in pixel units (the "mode" here 
is a term in statistics) in a designated portion of each image i (i=1,2,...n: n is a total number of stored images) 
which is stored in the image storage unit 20, where the designated portion of each image I corresponds to the 
portion designated by the operator In the sample image, and the pixel mode color is defined as a representative 
value of the portion. Then each value of three attributes in the HSV color space. H2i. S2i, and V2i. are extracted. 

It should be noted that in the aforementioned embodiment the representative value of the designated por- 
tion is defined by a mode color, however, it can be defined by a mean or a median in statistics, for instance. 

At step S4. the similarity between the sample image and the stored images are calculated based on two 
different sets of the extracted color information, that is. (H1, SI, V1) and (H2i, S2i, V2i), and also on each con- 
tribution factor decided in the contribution factors deciding unit 60. This process is explained later In detail with 
reference to Fig. 5. 

At step S5, the stored images are sorted in order of similarity in accordance with the similarity Ri (i=1 ,2,3, 
n). A stored Image which has the higher similarity is considered as more similar image to the sample image 
than the others. Note that the processes 4 and 5 are performed at the candidate image deciding unit 70. 

At step 6, the sorted images are displayed in order of the degree of the similarity on the display unit 90. 

Thus, the desired image is searched for from the stored images based on the cotor information of the sam- 
ple image made by the operator by following the aforementioned procedure. 

Next, the sample image input process of step S3 Is explained with reference to the flowchart of Fig. 3. The 
operator makes the sample Image In a window which is open on the screen of the display unit 90 in the image 
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processing apparatus by following the procedure shown in Fig. 3. 

At step S10, the operator designates a portion which represents an object image in the desired image by 
the pointing input device 31. 

At step S11, a color is designated in the portion. An example of color designation by using the screen of 
5 the display unit 90 is illustrated in Fig. 4. Reference numeral 41 denotes six color chips including the three 
primary colors (red, green, blue) and the intermediate colors of the three primary colors (yellow, cyan, ma- 
genta), 42 denotes slide-bars to adjust each value of the HSV. The operator designates a color which Is most 
similar to the color of portion by using the pointing input device 31 . Then the indicated color is considered as 
standard, and each values of the HSV is adjusted so that the color becomes more similar to the color of the 
10 object in the desired image by moving the slide-bars with the pointing input device 31 . The color under adjust- 
ment is displayed in a box 43 on the screen, so that the operator can see what kind of the color the operator 
designated. After the adjustment Is finished, the color designation is completed by clicking a "quit" display us- 
ing the pointing input device 31. Thereby the color of the portion of the sample image is decided. 

At step S12, the portion which is selected at step S10 is filled with the color decided at step S11. 
15 At step S13, the operator checks whether or not there is a need to designate another portion, and if not, 

the process of making the sample Image is completed. Further, if another portion needs to be designated, the 
process returns to step 10, and the same process described above needs to be repeated. 

Thus, the sample image is made by performing aforementioned steps. 

Next, the process to obtain the respective similarity between the sample image of step S4 and the stored 
20 images is described in detail with reference to the flowchart in Fig. 5. Note that it is assumed that only one 
portion is designated by the operator. In this process, the similarity are calculated based on the color Infomna- 
tion of the sample image (HI . S1 , V1 ) and on the color information of each stored image (H2i, S2I, V2i, where 
1=1 , 2, 3, ,n: n is a total number of the stored images). 

At step S30, first, each contribution factor, RH, RS, RV, for normalizing the three attributes of the color 
25 information of the sample image, HI , SI , and VI is decided by using the contribution factors deciding unit 60. 
The process in the contribution factors deciding unit 60 is described later with reference to Fig. 6. 

At step S31, the value differences of the three attributes between the color information of the sample im- 
age, HI, SI, and VI, and the color information of the stored images, H2i, S2i, and V2i, are calculated. The 
respective differences are described as, AHi(AHI=|H1-H2i I), ASi(ASi= I S1-S2I), and AVi(AVi= I V1 -V2i | ), 
30 where i=1, 2, 3, ,n: n is the total number of the stored images. 

At step S32, color differences, in which the contribution factors are considered, DHi(DHi=RH*Ahi), 
DSi(DSi=RS*ASi), and Dvi(Dvi=RV*AVi), where 1=1, 2, 3, ,n: n is the total number of the stored images, are 
calculated on the basis of RH, RS, and RV which are obtained at step S30, and of AHi. ASi, and AVi which are 
obtained at step S31. 

35 At step S33, DHi, DSi, and DVi are added, and similarity Ri (i=1 , 2, 3, , n: n is the total number of the stored 

images) is defined by the negative value of the result of the addition (-(DHi+DSi+DVi)). Likewise, similarity 
Rl(i=1 .2,3,.. .,n) of the each stored image are calculated. In a case where a plurality of portion are designated, 

the similarity RiJ (i=1,2.3 n:j=1,2,3....,m: m is a total number of portion.) are calculated by each image. Then 

a representative degree of similarity of each image is defined by, for instance, the total value of the degrees 

40 of the similarity relating the images, namely, the result of addition Ri=Ri1+RI2+...+Rim. 

Next, the process to decide the contribution factor of step S30 is described below in detail with reference 
to a flowchart in Fig. 6. The flowchart shows the process in the contribution factors deciding unit 60. 

Note that each contribution factor of the three attributes is denoted by RH, RS. and RV. and each of the 
factors ranges from 0.0 to 1.0. Further, the normalized values of the three attributes, that Is the normalized 

45 contribution factor, are denoted by RH, RS. and RV. Values of normalized contribution factors, which are out- 
putted from the contribution factors deciding unit 60. are RH, RS. and RV which are obtained after the nor- 
malization process described below. 

At step S20, the color information of the sample image which is extracted at step S2 in Fig. 2 is inputted 
into the contribution factors deciding unit 60 from the sample image input unit 30 via the control unit 80. 

50 At step S21, out of the color information of the sample image which is read at step S20, whether or not 

luminance VI is low, more specifically, whether or not the value of the luminance V1 is over predetermined 
threshold Tv, is examined. If the value of luminance VI Is smaller than the threshold Tv, the process proceeds 
to step S26, and contribution factor of hue H, chromaticity S, and luminance V are assigned as Rh=0. Rs=0, 
and Rv=1 , respectively. In other words, the low luminance means the low contribution factor of chromaticity. 

55 Then the process moves to step S24. 

At step S24, since the contribution factors. Rh, Rs. and Rv are decided, these three values are nonmalized 
to obtain the normalized contribution factors RH. RS, and RV. Following are the equations for normalizing cal- 
culation. 

4 
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RH = Rh/(Rh + Rs + Rv) 
RS = Rs/(Rh + Rs + Rv) 
RV = Rv/(Rh + Rs + Rv) 

Next, at step S22, whether or not chromaticity S1 is low, more specifically, whether or not the value of the 
5 chromaticity S1 is over predetermined threshold Ts. is examined. If the value of chromaticity S1 is smaller than 
the threshold Ts, the process proceeds to step S27, and contribution factor of hue H, chromaticity S. and lu- 
minance V are assigned as Rh=0, Rs=1 , and Rv=1 , respectively. Then the process moves to step S24. Where- 
as, if the value of chromaticity S1 is larger than the threshold Ts, the process proceeds to step S23. and con- 
tribution factors of hue H, chromaticity S, and luminance V are assigned as Rh=1, Rs-0, and Rv=0, respec- 
10 tively. Then the process moves to step S24 to perform a normalizing procedure. 

Thus, the normalized contribution factors of the three attributes, RH, RS, and RV are decided by following 
the above described procedure. 

As explained above, the desired image is searched out of the stored images in accordance with the color 
information of the sample image made by the operator. 
t5 Note that as an example of a sample image input means, the Image can be drawn on paper or the like, 

and read by a scanner instead of drawing on a display. 

Further, various ways to designate a color of a portion during the process of making a sample Image follow: 

1. Choose a color out of limited colors which are displayed on a screen. 

2. Designate a color by using color chips, and input a discrimination number of the designated color chip, 
20 3. Input values of color data, such as RGB and HSV, in the fomi of number. 

Further, in a case where RGB color data is used as the sample image data, the RGB color data needs to 
be converted into the HSV space data, since the image data in the image storage unit 20 is HSV space data. 
This conversion from the RGB data to the HSV data is performed by using the following conversion algorithm. 
The conversion algorithm are fully explained In Fundamentals of Interactive Computer Graphic (J.D.Foley, 
25 A.Vandam, pp61 3-620). 

max = The maximum value of R, and B 
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min = The minimum value of G, and B 
if (max ^ 0) 

then S = (max-min) /max 
else S = 0 
if S = 0 then H = undefined 
else 

begin rc = (max-R) / (max-min) 
gc = (max-G) / (max-min) 
be = (max-B) / (max-min) 
if (R = max) then 

20 

H = bc-gc 
else if (G = max) then 
25 H 2 + rc-bc 

else if (B = max) then 
H = 4+gc-rc 

30 

if (H £ 0) then H = H+360 
end 

35 Note that in the first embodrment the HSV color space is employed as a color perception space which is 

defined by hue, chronnaticity, and luminance. However, needless to say, it is possible to employ other color 
perception spaces, such as a Munsell color space. 

As explained above, according to this embodiment, it Is easier for an operator to search for a desired image 
by improving the quality of the search using color information when searching for the similar Images to the 

40 desired Image out of an Image database by using color Information. 

(Second Embodiment) 

As a method for deciding contribution factors of the three attributes of color data in the first embodiment, 
45 thresholds Tv and Ts are predetermined to obtain the contribution factors. There is another method to determine 
the contribution factor by using predetermined membership functions. In a second embodiment, another ex- 
ample of practice of the contribution factors deciding unit 60 Is described. 

Figs. 7 and 8 are examples of shapes of membership functions of luminance and chromaticity, respectively. 
In Fig. 7, a horizontal axis shows the value of luminance, and a vertical axis shows the membership grade of 
50 the corresponding luminance. Similarly, in Fig. 8, a horizontal axis shows the value of chromaticity, and a vert- 
ical axis shows membership grade of the corresponding chromaticity. The membership functions in Fig. 7 Il- 
lustrates a membership function 101 which indicates that the luminance is low, and a membership function 
100 which indicates that the luminance is not low. Likewise, the membership functions in Fig. 8 illustrates two 
membership functions 103 and 102, which indicates that the chromaticity is low, and that the chromaticity is 
55 not low, respectively. The membership functions 101 and 100 are denoted by M1v(i) and Mhv(i), respectively, 
hereinafter. Regarding I In the parenthesis, it indicates luminance. Further, M1v(l) and Mhv(l) are the member- 
ship grades relating to the luminance i. In the same manner, the membership functions 103 and 102 are de- 
noted by M1s(j) and Mhs(J), respectively, hereinafter. Regarding j in the parenthesis, it Indicates chromaticity. 

6 
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Therefore, M1s(j) and Mhs(j) are the membership grades relating to the chromaticity j. 

The process for deciding contribution factors of the three attributes of color data is explained below with 
reference to Figs. 9 and 10. Here, contribution factors (i.e.. RH. RS. and RV) of color data X(H1, SI . V1) of a 
sample image illustrated by using the HSV color space, RH. RS. and RV are calculated by using membership 
5 functions. Followings are processes at each step. 

At step S40. color information of a sample image (H1, 31, VI) which is extracted at step S2 in Fig. 2 is 
inputted into the contribution factors deciding unit 60 from the sample image input unit 30 via the control unit 
80. 

At step S41, membership grades. M1v(V1) and Mhv(VI) which correspond to luminance VI. are obtained 
10 by using the membership functions 101 and 100 in Fig. 7. 

At step S42, membership grades. M1s{S1) and Mhv(SI) corresponding to chromaticity S1. are obtained 
by referring to the membership functions 103 and 102 In Fig. 8. 

At step S43. the contribution factors. C1(x), C2(x), and C3(x) corresponding to three cases of the color 
data X are obtained based on the respective membership grades which are obtained at steps S41 and 842, 
15 where the three cases are case 1 (low luminance V), case 2 (high luminance V and low chromaticity S). and 
case 3 (high luminance V and high chromaticity S). The values of C1(x). C2(x) and C3(x) are given by the fol- 
lowing equations. 

C1(X) = M1v(V1) 
C2(X) = min(Mhv(V1), Mls(SI)) 
20 C3(X) = min(Mhv(V1). Mhs(SI)) 

At step S44. the contribution factors of the three attributes of colors. Rh, Rs and Rv are obtained by per- 
forming matrix operation represented by S44 In Fig. 10. 

At step S45, these three values are normalized, and the normalized contribution factors RH. RS. and RV 
are obtained. The normalized contribution factors are given by the following equations. 
25 RH = Rh/(Rh + Rs + Rv) 

RS = Rs/(Rh + Rs + Rv) 
RV = Rv/(Rh + Rs + Rv) 

The present invention can be applied to a system constituted by a plurality of devices, or to an apparatus 
comprising a single device. Furthermore, the invention is applicable also to a case where the object of the in- 
30 vention is attained by supplying a program to a system or apparatus. 

As described above, according to the embodiment, the contribution factor of image color component of 
better quality is obtained by using the membership functions, thereby the better performance of image search 
is accomplished. 

Furthermore, according to the embodiment the quality of search using color information is improved when 
35 an image is searched from the image database. 

As many apparently widely different embodiments of the present invention can be made without departing 
from the spirit and scope thereof, it is to be understood that the invention is not limited to the specific embodi- 
ments thereof except as defined in the appended claims. 

40 

Claims 

1. An image searching method for searching for an image database by using color information containing a 
plurality of color components, comprising: 

a contribution factor calculation step of calculating a contribution factor of each color component 
of color information on the basis of the color information; 

a similarity calculation step of calculating similarity between the color infomnation and a plurality 
of predetermined color Information based on said contribution factor of each color component of color in- 
formation; and 

a displaying step of sorting said plurality of predetermined color information corresponding to said 
similarity in order of said similarity, and of displaying the sorted predetermined color information on a dis- 
play means. 

2. The image searching method according to Claim 1 , wherein said each color component of color infonma- 
tion is hue, chromaticity, and luminance. 

3. The Image searching method according to Claim 1, wherein, at said contribution factor calculation step, 
the contribution factor corresponding to said each color component of color information is calculated 

7 
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based on the comparison between said each color component of color information and each predeter- 
mined threshold. 

The image searching method according to Claim 2, wherein, at said contribution factor calculation step, 
If luminance of said color information Is lower than a predetermined threshold, then a contribution factor 
corresponding to the luminance is set to be high, and wherein if the luminance is higher and chromaticity 
of the color Information Is higher than the predetermined thresholds, then a contribution factor correspond- 
ing to hue is set to be high, further wherein if the luminance of said color information is higher and the 
chromaticity of said color information is lower than the predetermined thresholds, then the contribution 
factor of the chromaticity of the color Information and the contribution factor of the luminance of the color 
information are set to be high. 

The image searching method according to Claim 2, wherein, at said contribution tector calculation step, 
the calculation is performed based on a plurality of membership functions which show membership grades 
of chromaticity and luminance of the color information. 

The image searching method according to Claim 1 , wherein the color information is generated at a color 
information generating step of generating color information. 

An image searching method for searching for an image out of an image database by using color infonna- 
tion, comprising: 

a generating step of generating a sample image including color information; 

a contribution factor calculation step of calculating a contribution factor of color information based 
on the color information of the sample image; 

a similarity calculation step of calculating similarity between the sample image and respective im- 
ages from an image database, based on the contribution factor; and 

a displaying step of displaying said respective images from the image database on a display means 
in order of the similarity. 

The image searching method according to Claim 7, wherein color components of said color information 
are hue, chromaticity, and luminance. 

The image searching method according to Claim 8, wherein, at said contribution factor calculation step, 
the contribution factors corresponding to said color components of the color information of the sample 
image are calculated based on a comparison between said color components of the color information of 
the sample image and predetermined thresholds. 

The image searching method according to Claim 8, wherein, at said contribution factor calculation step, 
if luminance of the color information is lower than a predetenmined threshold, then the luminance is set 
to be high, and wherein if the luminance is higher and chromaticity of the color information is higher than 
the predetermined thresholds, then a contribution factor corresponding to the contribution factor corre- 
sponding to hue of the color information is set to be high, further wherein If the luminance of said color 
information is higher and the chromaticity of the color information is lower than the predetermined thresh- 
olds, then the contribution factor of the chromaticity of the color information and the contribution factor 
of the luminance of the color information are set to be high. 

The image searching method according to Claim 8. wherein, at said contribution factor calculation step, 
the calculation is performed based on a plurality of membership functions which show membership grades 
of chromaticity and luminance of the color information. 

An image searching apparatus for searching for an image database by using color information containing 
a plurality of color components, comprising: 

contribution factor calculation means for calculating a contribution factor of each color component 
of color Information on the basis of the color information; 

similarity calculation means for calculating similarity between the color information and a plurality 
of predetermined color information based on said contribution factor of each color component of color in- 
formation; and ' 

displaying means for sorting said plurality of predetermined color information corresponding to said 
similarity in order of said similarity, and of displaying the sorted predetermined color information on a dis- 
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play means. 

The image searching apparatus according to Claim 12. wherein said each color component of color in- 
formation is hue, chromaticlty, and luminance. 

The image searching method according to Claim 12, wherein said contribution factor calculation means 
calculates the contribution factor corresponding to sard each color component of color information based 
on the comparison between said each color component of color information and each predetermined 
threshold. 

The image searching apparatus according to Claim 13, wherein said contribution factor calculation means 
sets a contribution factor corresponding to the luminance to be high, if luminance of said color information 
is lower than a predetermined threshold, and wherein sets a contribution factor corresponding to hue to 
be high, if the luminance is higher and chromaticity of the color information is higher than the predeter- 
mined thresholds, further wherein sets the contribution factor of the chromaticity of the color infonmation 
and the contribution factor of the luminance of the color information to be high,. if the luminance of said 
color information is higher and the chromaticity of said color information is lower than the predetermined 
thresholds. 

The image searching apparatus according to Claim 1 3. wherein said contribution factor calculation meth- 
od calculates based on a plurality of membership functions which show membership grades of chroma- 
ticity and luminance of the color information. 

The image searching apparatus according to Claim 12, wherein the color information is generated by a 
color information generating means. 

An image searching apparatus for searching for an image out of an image database by using color infor- 
mation, comprising: 

generating means for generating a sample image including color information; 

contribution factor calculation means for calculating a contribution factor of color information based 
on the color information of the sample image; 

similarity calculation means for calculating similarity between the sample image and respective 
images from an image database, based on the contribution factor; and 

displaying means for displaying said respective images from the image database on a display 
means in order of the similarity. 

The image searching apparatus according to Claim 18. wherein color components of said color informa- 
tion are hue, chromaticity. and luminance. 

The image searching apparatus according to Claim 18, wherein said contribution factor calculation means 
calculates the contribution factors corresponding to said color components of the color information of the 
sample image based on a comparison between said color components of the color information of the sam- 
ple image and predetermined thresholds. 

The image searching apparatus according to Claim 19, wherein said contribution factor calculation means 
sets the luminance to be high, if luminance of the color information Is lower than a predetermined thresh- 
old, and wherein sets a contribution factor corresponding to the contribution factor corresponding to hue 
of the color information to be high, if the luminance is higher and chromaticity of the color information is 
higher than the predetermined thresholds, further wherein sets the contribution factor of the chromaticity 
of the color information and the contribution factor of the luminance of the color information to be high, if 
the luminance of said color information is higher and the chromaticity of the color information is lower than 
the predetermined thresholds. 

The image searching apparatus according to Claim 19, wherein said contribution factor calculation means 
calculates based on a plurality of membership functions which show membership grades of chromaticity 
and luminance of the color information. 

An image searching method for searching an image database for a selected image comprising the steps 
of determining the color attributes of the selected image; and normalising the color attributes in depend- 
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ence on the magnitudes of the color attributes; and using the normalised color attributes to search the 
image database. 

24_ An Image searching apparatus for performing a method according to Claim 23. 
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